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ARI  Research  Reports  and  Technical  Reports  are  intended  for  sponsors  of 
R&D  tasks  and  for  other  research  and  m'litary  agencies.  Any  findings  ready 
for  implementation  at  the  time  of  publication  are  presented  in  the  last  part 
of  the  Brief.  Upon  completion  of  a  major  phase  of  the  task,  formal  recom¬ 
mendations  for  official  action  normally  are  conveyed  to  appropriate  military 
agencies  by  briefing  or  Disposition  Form. 


FOREWOFtD 


The  Fort  Leavenworth  Field  Unit  of  the  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences  supports  the  Combined  Arms  Center  with  research 
and  development  on  command  group  training  and  command  staff  operations.  Among 

research  is  conducted  to  improve  training  of  tacti- 
doctrine  and  C^  system  operation.  An  integred 
part  of  command  group  training  is  the  after  action  review  (AAR)  process.  Dur¬ 
ing  the  AAR,  participants  discuss  performance  to  discover  why  events  occurred 
as  they  did  and  identify  areas  where  improveieent  is  needed.  'Riis  study  identi¬ 
fies  principles  that  should  be  followed  for  an  effective  feedback  process  and 
examines  several  AARs  for  adherence  to  these  principles.  This  analysis  pro¬ 
vides  the  basis  for  guidelines  on  how  command  group  training  AARs  should  be 
conducted. 

This  research,  conducted  under  ARI  research  task  1.3.3*  Improved  Methods 
for  Command  Group  Training,  was  initiated  through  agreement  with  the  Battle 
Simulation  Directorate,  U.S.  Army  Command  and  General  Staff  College,  U  April 
196U,  entitled  Performance  Assessment  and  Training  Feedback  Module  for  the 
Army  Training  Battle  Simulation  System  (ARTBASS).  The  results  of  this  re¬ 
search  were  briefed  to  the  ARTBASS  Team  Chief  of  the  Combined  Arms  Training 
Activity  (CATA),  September  I985,  and  to  the  Combined  Arms  Training  Support  Di¬ 
rectorate,  CATA,  Msrch  1987.  The  ARTBASS  Team  Chief  concurred  with  the  find¬ 
ings  and  recommendations  on  AARs,  and  they  were  incorporated  into  PC  101-2, 

How  to  Train  with  ARTBASS.  The  Training  Support  Directorate  will  use  the  re¬ 
sults  in  tue  preparation  of  a  video  tape  training  aid  on  how  to  conduct  AARs. 


the  wide  range  of  projects, 
cal  command  and  control  (C^) 
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ANABASIS  OF  FEFDBAClC  IN  AFTER  ACTION  REVIEWS 


EXECUTIVE  SUMMARY 


Requirement : 

After  motion  reviews  (AARa)  are  a  critical  part  of  a  command  group  train¬ 
ing  exercije.  Through  AARa,  training  performance  is  reviewed  and  feedback  is 
provided  to  the  training  audience.  Observation  of  numerous  AARs  has  suggested 
that  the  effectiveness  of  procedures  in  the  AARs  varies  greatly.  The  purpose 
of  this  research  was  to  develop  and  implement  a  methodology  for  analyzing 
videotapes  of  AARs  and  to  examine  patterns  of  messages  occurring  in  battalion 
command  staff  exercise  AARs. 


Procedure : 

Relevant  feedback  Issues  were  identified  through  a  review  of  the  litera¬ 
ture.  Twelve  research  questions  that  have  a  potential  Impact  on  the  effective¬ 
ness  of  the  AAR  were  specified.  Data  on  feedback  sources  and  participation 
were  collected  using  a  technique  referred  to  as  message  content  analysis.  The 
content  analysis  was  performed  under  two  schemes:  one  to  identify  the  topics 
discussed  and  the  second  to  identity  the  feedback  processes  employed. 


Findings; 

The  core  group  of  feedback  sources  and  the  general  ranking  of  participa¬ 
tion  in  the  AARs  were  Battalion /Task  Force  Commanders,  ARTBASS  leaders,  and 
company  commanders.  The  Opposing  Force  (OPFOR),  S2,  S3,  SU,  and  Fire  Support 
Officer  (FSO)  were  moderate-level  participants. 

Topics  discussed  in  the  AARs  were  rank  ordered  with  enemy  characteristics 
discussed  most  frequently  and  planning  discussed  least  frequently.  The  analy¬ 
sis  indicated  that  the  problem  areas  discussed  most  frequently  were  information 
and  coordination.  Reasons  cited  for  the  difficulty  in  information  included  the 
adequacy  of  information,  ambiguity  in  messages,  timeliness,  critical  reporting 
relationships,  and  variations  in  interpreting  messages. 

The  coordination  problem  was  subdivided  further  into  five  categories: 
excessive  casualty  rates,  uncertainty  about  battle  objectives,  ammunition  ex¬ 
pended  too  qul'.kly,  difficulty  in  surveillance  of  enemy  forces,  and  inadequate 
plans  for  resupply  and  refueling. 

The  AARs  were  conducted  effectively  in  accordance  with  four  known  princi¬ 
ples  of  good  feedback  procedures.  First,  the  feedback  was  found  bo  be  oriented 
toward  describing  actual  behavioral  performance,  rather  than  personal  charac¬ 
teristics  of  the  performers.  Second,  performance  was  linked  to  battle  objec¬ 
tives  at  a  reasonable  rate.  Next,  discussion  of  future  performance  objectives 


vii 


occurred  vith  relatively  reasonable  frequency*  Last,  the  use  of  bo^h  general 
and  specific  oMssages  occurred  at  an  effective  rate. 

Several  feedback  areas  that  did  not  neet  reasonable  levels  of  effective> 
ness  uere  observed.  Requests  and  submissions  during  the  AAR  for  rationales 
concerning  battle  performance  were  too  infrequent.  When  messages  were  attrib¬ 
uting  blame,  the  stessagas  were  too  abstract  and  were  not  as  effective  as  pos¬ 
sible.  The  major  problem  in  the  sample  AARs  was  infrequent  use  of  the  ques¬ 
tioning  technique  by  the  AAR  leader. 


Utilisation  of  Findings: 

The  content  analysis  methodology  proved  to  be  workable  and  produced  infor¬ 
mation  results  on  AARs.  The  topic  categories  identified  have  potential  appli¬ 
cation  to  command  group  training  exercises  as  a  source  from  which  to  derive 
training  objectives  and  as  discussion  items  in  the  AARs.  The  results  of  the 
feedback  process  analysis  characterised  the  effectiveness  of  A/).R  feedback  and 
indicated  several  areas  where  feedback  was  employed  ineffectively.  Examples 
derived  of  effective  and  ineffective  feedback  have  been  incorporated  into  a 
guidelines  document  for  conducting  AARs  (refer  to  Kaplan  &  Fallesen,  1986,  and 
Appendix  B) . 
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ANALYSIS  OF  FEEDBACK  IN  AFTER  ACTION  REVIEWS 


INTRODUCTION 

Perforaance  feedback  should  be  provided  to  a  command  staff  undergoing 
training  to  engender  a  cowducive  learning  environment.  One  means  of  providing 
feedback  is  through  a  process  referred  to  as  the  after  action  review  (AAR). 

In  the  AAR,  performance  is  reviewed  in  relauion  to  stated  training  objectives. 
Training  participants  are  led  through  a  discussion  which  reviews  actions  taken, 
explores  the  rationale  for  those  actions,  recognizes  problems,  and  identifies 
potential  corrective  actions  (Kaplan  and  Fallesen,  1986).  Tlie  National  Train¬ 
ing  Center  (NTC)  and  the  Army  Training  Battle  Simulation  System  (ARTBASS)  have 
adopted  the  practice  of  AARs  as  an  integral  part  of  their  training  program. 

The  AAR  is  in  marked  contrast  to  the  critique  method  of  feedback  which  is 
often  used  in  military  training.  The  AAR  method  aims  to  create  a  situation 
where  participants  are  active  and  interactive  rather  than  passive  as  they  are 
in  the  critique  method.  Research  has  consistently  shown  that  active  partici¬ 
pation  in  a  learning  activity  greatly  increases  the  amount  learned  and  re¬ 
tained,  and  that  involvement  can  reduce  one's  resistance  to  recognizing  one's 
own  mistakes. 
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There  are  a  number  of  other  well-established  feedback  principles  that  af¬ 
fect  the  conduct  of  the  AAR.  The  purpose  of  this  report  is  to  clearly  identify 
issues  which  might  affect  the  adequacy  of  the  AAR  and  to  assess  the  extent  to 
which  the  principles  were  followed  in  selected  exercises. 

A  Perspective  on  Feedback 


No  concept  is  more  basic  to  theories  of  human  communication  and  learning 
than  feedback.  Feedback,  as  described  by  Wiener  (19W)  in  the  discipline  of 
cybernetics,  is  a  loop  by  which  information  about  actual  behavioral  perfor¬ 
mance  is  used  to  correct  and  guide  future  behavior  toward  some  predetermined 
goal.  Originally  the  application  was  to  machines  where  communication  forms 
were  relatively  simple  and  corrective  "learning"  relatively  constrained,  but 
behavioral  scientists  were  quick  to  see  the  application  of  such  a  corrective 
guidance  mechanism  in  human  communication  and  learning  contexts. 

Most  investigatoi s  characterize  feedback  as  a  process  involving  four  key 
elements,  a  feedback  source,  a  message  with  certain  characteristics,  a  feed¬ 
back  recipient,  and  feedback  information  patterns  such  as  frequency  and  tim¬ 
ing.  Feedback  involves  coordinated  activity  between  the  source  and  recipient 
whereby  informational  patterns  are  created  involving  messages  containing  dif¬ 
ferent  types  of  infoii  ’,tion  about  past  behavioral  performance,  the  consequences 
of  that  performance,  ohe  future  goal  or  objective  to  be  met,  and/or  a  continu¬ 
ation  or  correction  of  action  in  order  to  meet  a  future  goal  or  objective. 

This  description  of  the  feedback  process  is  consistent  with  Wiener's  general 
description  of  feedback  loops  and  with  his  uses,  or  functions,  of  feedback. 


Organizational  communication  researchers  regard  feedback  as  an  important 
concept  for  several  reasons.  First,  personal  feedback  is  desired  by  most  em¬ 
ployees  and  has  a  high  correlation  with  Job  satisfaction  (Downs  A  Hazen,  1977; 
Spencer  A  Steers,  1981).  Second,  feedback  is  considered  a  most  important 
variable  in  learning  and  performance  (Cusella,  1980).  Several  studies  have 
contrasted  feedback  conditions  with  no  feedback  conditions,  and  more  effective 
performance  is  always  associated  with  feedback  ( Fryer  A  Bass,  1959;  Brockner, 
1979;  Larson  4  Skolnik,  1982).  Finally,  feeding  information  about  performance 
back  to  Individuals  and  to  small  and  large  groups  is  assumed  to  be  a  poten¬ 
tially  powerful  means  to  enhance  organizational  effectiveness,  as  most  models 
of  organizational  effectiveness  contain  a  feedback  component. 

Most  researchers  have  emphasized  the  directive  and  motivational  functions 
of  feedback  as  their  descriptions  indicate  feedback  provides:  (l)  rewards,  (2) 
uncertainty  reduction,  (3)  error  detection,  (4)  secondary  reinforcement,  (5) 
knowledge  of  results,  (6)  knowledge  of  performance,  (7)  information  about  self, 
(8)  information  about  unit  performance,  and  (9)  motivation  for  correction. 

While  specific  uses  of  feedback  may  vary,  current  organizational  communication 
research  is  directed  toward  examining  the  variables  related  to  the  most  effec¬ 
tive  forms  and  uses  of  feedback  as  well  as  how  these  forms  and  uses  of  feedback 
enhance  performance. 


Overview  of  Current  Research 


The  present  study  which  is  descriptive  in  nature  was  designed  to  examine 
feedback  sources,  feedback  content,  and  feedback  message  structure  which  were 
employed  in  six  AARs  conducted  during  ARTBASS  (Borrelli,  1984)  training  exer¬ 
cises.  A  content  analytic  schema  was  used  in  analyzing  the  content  and  func¬ 
tion  of  the  messages  (Watzlawick,  Beavin,  and  Jackson,  1967).  Content  analysis 
was  employed  as  the  methodology  because  it  provides  "the  best  descriptive  means 
for  a  systematic  search  through  messages"  (Holsti,  1969)* 

The  following  research  report  is  organized  into  four  sections.  The  first 
section  provides  a  brief  review  of  the  literature  concerning  feedback  sources 
and  feedback  message  characteristics  as  they  directly  relate  to  the  objectives 
of  this  study  and  the  basic  principles  of  the  after  action  review.  In  addi¬ 
tion,  basic  research  issues  are  highlighted.  The  methods  and  procedures  used 
in  analyzing  the  data  are  described  in  the  second  section.  In  the  third  sec¬ 
tion,  the  results  are  presented.  Finally,  the  implications  of  the  results  are 
discussed  and  recommendations  are  made. 
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IDENTIFICATION  OP  FEEDBACK  ISSUES 


Feedback  Sources 


Three  general  types  of  feedback  sources  have  been  identified  in  the  feed¬ 
back  literature.  The  individual  or  self  is  an  important  feedback  source  as 
research  demonstrates  that  individual  job  performance  begins  to  improve  before 
a  supervisor  gives  feedback.  Some  researchers  speculate  that  gaining  experi¬ 
ence  and  expertise  on  the  job  allows  an  individual  to  monitor  his/her  own  per¬ 
formance  (llgen,  Fisher,  &  Taylor,  1979;  Greller,  1980).  Observers  such  as 
supervisors,  peers  or  subordiiates  also  constitute  a  feedback  source.  A  final 
type  of  feedback  is  task-inherent  feedback.  Task-inherent  feedback  refers  to 
human-machine  interacting  systems,  e.g. ,  computers,  where  in  a  visual  tracking 
task,  the  machine  makes  it  "apparent  immediately  when  the  individual  is  not  on 
target."  (llgen,  et  al.,  1979;  p.  350).  To  date,  no  single  study  has  investi¬ 
gated  these  general  types  of  sources  simultaneously;  therefore,  conclusive  com¬ 
parisons  among  them  are  not  possible. 

Although  early  research  tended  to  focus  on  one  general  source  of  feedback, 
current  research  appears  to  be  directed  toward  comparisons  between  observer- 
provided  and  self-generated  feedback  on  job  performance.  Research  on  this 
issue  ueems  to  take  two  directions:  studies  on  perceptions  of  source  impor¬ 
tance,  and  studies  on  self-generated  versus  supervisor-generated  feedback  and 
goal  setting  on  performance. 

Perceptions  of  Importance 

Research  conducted  on  perceptions  of  feedback  source  importance  reveals 
differences  between  supervisors  and  employees.  In  a  field  descriptive  study  of 
a  transit  company,  Greller  (1980)  reported  that  supervisors  rated  themselves  as 
more  important  80Ui.‘ces  of  feedback  than  did  the  employees.  Additionally,  su¬ 
pervisors  rated  co-worker  or  peer-generated  feedback  and  individual  or  self¬ 
generated  feedback  as  less  important  sources  of  feedback  than  did  the  employ¬ 
ees.  Greller' 8  results  suggest  that  supervisors  over  estimate  the  importance  of 
their  own  feedback  to  employees  and  often  fail  to  recognize  the  importance 
employees  place  on  other  sources  of  feedback.  Other  organizational  simulation 
studies  (DeNisi,  Randolph,  &  Blencoe,  1982;  Kanfer,  Karoly,  &  Newman,  1974) 
provide  general  support  for  Greller' a  discovery  that  employees  perceive  other 
sources  of  feedback  as  important  as,  and  in  some  cases  more  important  than, 
supervisor  generated  feedback. 


Self-Generated  vs.  Superior-Generated  Feedback 

Research  examining  the  effects  of  self-generated  versus  supervisor-gener¬ 
ated  feedback  and  goal  setting  on  performance  has  produced  interesting  results. 
In  one  quasi-experimental  field  study  involving  blue  collar  union  employees, 

Kim  and  Hamner  (1976)  concluded  from  their  results  that  when  management  sets 
the  goals  for  employees,  the  source  of  feedback  makes  little  difference  in 
their  objocti/e  performance,  although  goal  setting  and  feedback  are  superior 
to  goal  setting  alone.  In  a  second  quasi-experimental  field  study  of  civil, 
mechanical,  industrial,  and  electrical  engineers,  Ivancevich  and  McMahon  (1982) 
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reported  that  self-generated  feedback  T<raa  superior  to  supervisor-generated 
feedback  in  enhancing  objective  performance  with  employees  who  set  their  own 
goals.  Although  the  generalizability  of  the  specific  findings  from  both  stud¬ 
ies  to  other  organizations  is  unknown  because  of  the  limitations  in  their  re¬ 
search  designs,  the  results  suggest  that  th«  effectiveness  of  self-generated 
versus  supervisor-generated  feedback  on  objective  performance  may  vary  between 
goal  setting  and  non-goal  setting  employees. 

Research,  examining  multiple  sources  of  feedback  simultaneously,  has  been 
considered  only  recently  and  few  studies  have  been  reported.  For  practitio¬ 
ners,  however,  one  conclusion  seems  quite  reasonable:  encouraging  multiple 
sources  for  employee  feedback  to  enhance  job  performance  is  preferable  to  rely¬ 
ing  on  a  single  source.  Since  this  practice  is  encouraged  in  the  AAR  (Scott  4 
Fobes,  1982),  the  feedback  sources  were  determined  by  examining  who  partici¬ 
pated  in  the  AARs  and  to  what  extent. 


Feedback  Content 


Little  research  has  been  reported  in  the  organizational  communication  lit¬ 
erature  on  the  content  or  topic  levels  of  feedback.  This  lack  of  research  is 
due  to  the  fact  that  current  theory  recognizes  that  the  contents  or  topics  of 
messages  are  context-dependent.  In  essence,  the  topics  discussed  by  Army  per¬ 
sonnel  in  an  AAR  will  be  quite  different  from  the  topics  discussed  by  depart¬ 
ment  store  personnel  during  a  performance  appraisal  feedback  session  due  to  the 
different  organizational  contexts.  Since  communication  researchers,  like  other 
social  scientists,  are  interested  in  obtaining  generalizable  results  from  their 
research,  analysis  of  the  content  levels  of  messages  has  received  little  atten¬ 
tion. 

Nevertheless,  analysis  of  the  content  level  of  messages  is  important  for 
the  personnel  involved  in  the  AAR.  In  particular,  topic  analysis  is  the  start¬ 
ing  point  for  training  diagnosis,  i.e.,  the  "heart  of  the  AAR"  (Scott  and 
Fobes,  1982).  Specifically,  an  AAR  training  diagnosis  involves  three  steps  on 
the  part  of  the  analyst:  identifying  what  happened,  identifying  how  it  hap¬ 
pened,  and  identifying  why  it  happened.  The  first  stage,  identifying  what 
happened,  requires  that  the  analysts  identify  important  battle  events.  Second, 
in  identifying  how  the  important  events  occurred,  the  analysts  must  increase 
their  understanding  by  gathering  facts  about  actions  preceding  and  following 
the  important  events.  Finally,  the  analysts  must  create  chains  of  events  and 
make  inferences  concerning  the  causes  and  effects  of  the  important  battle 
events  in  order  to  determine  why  these  events  occurred.  A  topical  analysis 
serves  to  identify  those  events  and  actions  seen  as  important  or  as  related  to 
important  battlefield  events  by  the  participants.  Hence,  this  study  examined 
what  topics  were  discussed  and  which  ones  were  identified  as  problem  areas. 

The  type  of  information  transmitted  in  the  message  is  also  related  to  feed¬ 
back  content.  This  study  examined  four  aspects  of  the  information  in  AAR  feed¬ 
back  messages.  They  were  whether  the  feedback  pertains  to  actual  performance 
or  the  recipient's  personal  characteristics;  whether  the  feedback  is  diagnos¬ 
tic,  examining  rationales  for  performance;  whether  the  feedback  is  related  to 


group/ inctlvidual  learning  objectives  or  bask  goals;  and  whether  the  feedback 
addressed  if  corrective  action  was  needed,  and,  if  so,  what  it  should  be. 
Research  on  each  aspoct  is  reported  as  follows. 

Performance  vs.  Personal  Charac teristic". 


Feedback  should  be  directed  toward  behavior  which  the  recipient  can  cor- 
rect,  rather  than  directed  toward  personal  characteristics.  This  principle  has 
become  an  education  and  communication  truism  (Applbaum,  Bodaken,  Sereno,  & 
Anatol,  1979;  Gordon,  1974).  Jacobs,  Jacobs,  Feldman,  and  Cavior  (1973)  re¬ 
ported  that  negative  feedback  focused  on  behavioral  performance  was  viewed  by 
recipients  as  more  credible  than  negative  feedback  centered  on  personal  charac¬ 
teristics  and  was  neaT3.y  as  well  received  as  positive  feedback.  This  line  of 
research  was  the  basis  for  examining  whether  feedback  in  AARs  described  per¬ 
formance  or  personal  characteristics. 

Ra tionale.  A  second  type  of  information  that  the  feedback  may  convey  con¬ 
cerns  messages  addressed  toward  determining  participants'  rationale  for  pe]> 
formance.  Little  previous  I'esearch  exists  on  this  component.  However,  Pearce 
and  Cronen  (1980)  have  demonstrated  that  a  persons'  behavioral  performance  may 
be  influenced  by  their  perceptions  of  antecedent  conditions,  such  as  the  amount 
and  types  of  Information  they  have,  their  level  of  information  processing,  and 
their  anticipation  of  subsequent  conditions.  In  addition,  these  researchers 
have  found  that  in  order  to  change,  correct,  or  improve  behavioral  perfovnance 
it  is  often  necessary  to  find  out  why  they  did  what  they  did. 

Goals.  A  third  information  type  is  messages  which  refei'ence  task-relevant 
goals  or  objectives.  Researchers  examining  the  feedback  process  in  organiza¬ 
tional  settings  have  studied  feedback  about  actual  performance  and  its  rela¬ 
tionship  to  task-goals  or  objectives.  Several  researchers  have  found  that 
neither  feedback  about  performance  alone  nor  goal  sotting  by  itself  motivates 
toward  improved  performance.  However,  feedback  in  combination  with  goals  has  a 
positive  effect  upon  performance  (Locke,  Frederick,  Cousins,  4  Bobko,  1983;  Kim 
4  Hamner,  1976).  Similarly,  Nemeroff  cmd  Cosentino  (1979)  conducted  a  field 
study  that  found  goal  setting  combined  with  feedback  directed  toward  behavioral 
performance  to  be  superior  to  no  feedback  or  Just  feedback  alone,  in  affecting 
the  subordinate's  perceptions  of  appraisal  success  and  their  motivation  to 
improve.  Clearly,  messages  which  reference  goals  in  conjunction  with  messages 
which  provide  feedback  about  performance  enhance  the  feedback  process  and  im¬ 
prove  subsequent  performance. 

Corrective  Action.  The  final  type  of  information  in  feedback  involves 
whether  a  continuation  or  a  correction  in  performance  shown  in  the  past  is  de¬ 
sired.  Again,  both  the  research  and  prescriptive  literature  in  educational 
psychology  and  communication  studies  agree  on  the  following  guideline:  once 
"effective"  behavioral  performance  or  "mistakes"  in  behavioral  performance  have 
been  communicated,  messages  encouraging  a  continuation  of  past  effective  per¬ 
formance  or  presenting  alternative  courses  of  action  to  correct  "mistakes"  are 
more  effective  in  enhancing  future  performance  than  when  such  information  is 
not  part  of  the  feedback  process  (Gordon,  1974;  Applbaum  et  al.,  1979). 
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Mes8«Ke  Structures 


Messages  may  contain  Information  concerning  the  dimensions  of  form,  .level, 
and  valence,  in  addition  to  those  referencing  basic  components  of  the  feedback 
process*  Each  of  these  dimensions  can  influence  the  effectiveness  of  the  feed¬ 
back  process. 

Form 


Sources  may  present  feedback  in  the  form  of  a  lecture  or  may  Invite  recipi¬ 
ents  to  participate  more  actively  in  the  process  or  they  may  combine  these  two 
basic  forms*  Feedback  messages  in  a  lecture  format  can  be  described  as  an  ex¬ 
tended  sequence  of  "comments"*  Conversely,  feedback  messages  in  a  recipient 
participation  format  can  be  described  as  consisting  of  alternative  "question" 
and  "comment"  sequences*  Educational  research  has  shown  consistently  that  in  a 
learning  context,  recipient  participation  in  the  feedback  process:  decreases 
resistance  to  Information,  increases  motivation,  and  allows  for  an  indepth 
exploration  of  issues  being  discussed.  The  questioning  technique  is  the  recom¬ 
mended  format  of  the  AAR,  so  the  extent  to  which  this  format  is  actually  ap¬ 
plied  was  addressed* 

Abstraction 


A  second  dimension  of  feedback  messages  is  the  level  of  abstraction  as  a 
result  of  word  selection*  Research  consistently  reveals  that,  in  general, 
feedback  messages  which  contain  specific  information  (e.g*,  descriptions  of 
specific  behaviors)  are  more  meaningful  and  useful  to  recipients  than  messages 
which  contain  abstract  Information  (Applbaum  et  al.,  1979)*  In  addition  to  the 
importance  of  giving  specific  information  when  referencing  "past  behavioral 
performance"  and  "future  behavioral  performance,"  subjects  assigned  specific 
goals  have  out-performed  subjects  assigned  abstract  goals  while  working  on  the 
same  task  (Dosset,  Latham,  &  Mitchell,  1979;  Tolchinsky  &  King,  1980). 

Although  research  supports  the  contention  that  specific  messages  are  pref¬ 
erable  to  abstract  messages  during  feedback,  these  studies  have  classified 
messages  as  either  "all  abstract"  or  "all  specific"  within  limited  organiza¬ 
tional  contexts*  General  semantlcists  have  ''efexred  dlsparlngly  to  messages 
which  are  either  all  abstract  or  all  specific  as  the  problem  of  "dead  level 
abstraction"  (Condon,  1975),  and  suggest  that  communicators  should  use  specific 
messages  to  help  explain  abstract  messages  which  reflect  general  principles.  A 
high  preponderance  of  abstract  messages  may  Indicate  that  recipients  nad  some 
difficulty  in  finding  some  aspects  of  the  feedback  process  meaningful  and  use¬ 
ful.  Conversely,  a  high  preponderance  of  specific  behaviorally-oriented  mes¬ 
sages  may  constrain  recipients  learning  about  generally  applicable  principles. 
In  this  research  the  extent  of  abstract  and  specific  messages  was  examined. 

Valence 


A  final  dimension  of  the  feedback  message  structure  is  valence.  Valence 
refers  to  whether  the  feedback  was  positive,  negative,  mixed,  or  neutral.  The 
valence  dimension  commonly  is  limited  to  the  first  two  categories,  regardless 
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of  the  degree  of  positivism  or  negativity  conveyed  in  the  message.  While  this 
is  a  weakness  of  the  reported  research,  several  tentative  conclusions  are  pos¬ 
sible. 

Nadler  (1979)  Indicated  that  feedback's  evaluative  content  is  an  important 
factor  in  its  effects  and  positive  feedback  content  initiates  change  in  par¬ 
sons'  perceived  competence  on  a  task  and  increases  the  level  of  intrinsic  moti¬ 
vation  (Cusella,  in  press).  In  addition  to  motivation,  Nadler  relates  positive 
feedback  content  to  changes  in  group  interaction  and  personal  attributions. 
Nadler  argues  that  negative  feedback:  promotes  defensive  feelings,  raises 
aspirations  less  than  positive  feedback,  leads  to  attributions  concerning  ex¬ 
ternal  causes  on  the  part  of  the  recipient,  and  leads  to  more  distortions  by 
the  recipient. 

Pointing  out  that  feedback  arouses  strong  emotions,  Jacobs,  Jacobs, 

Feldman,  and  Cavior  (1973)  characterized  feedback  as  more  than  an  objective 
transfer  of  information.  They  found  that  positive  feedback  is  generally  rated 
by  its  recipients  as  more  credible  than  negative  feedback.  They  suggest  that  in 
order  for  negative  feedback  to  be  well  received,  it  should  be  maximally  infor¬ 
mative  and  minimally  evaluative.  Furthermore,  different  types  of  people  handle 
negative  feedback  differently.  There  is  some  evidence  that  people  who  have 
confidence  and  the  need  for  achievement  may  seek  negative  feedback  to  increase 
performance  whereas  people  with  less  esteem  and  need  for  achievement  may  be 
defeated  by  negative  evaluation  (McFarlin  &  Blascovlch,  1981).  In  an  experi¬ 
ment  with  psychology  students,  DeNisi,  Randolph,  and  Blencoe  (1982)  reported 
that  variations  in  positive  versus  negative  evaluations  made  a  difference  in 
students'  reactions.  The  researchers  concluded  that  actual  performance  is 
facilitated  best  by  a  mixture  of  positive  and  negative  feedback  evaluation. 

A  very  special  type  of  positively  valenced  feedback  that  has  been  explored 
is  the  Influence  of  praise.  Kim  and  Hamner  (1976)  report  that  it  has  affected 
performance  positively.  Conducting  a  field  study  in  three  organizations, 
Alexander  and  Camden  (1980),  found  that  praise  has  an  important  effect  on  supe¬ 
rior-subordinate  relations  and  that  it  correlates  significantly  with  job  satis¬ 
faction.  They  described  the  use  of  evaluative  as  opposed  to  descriptive  praise 
as  a  major  barrier  to  effective  feedback. 

In  general,  positively  and  neutrally  (descriptive  only)  valenced  messages 
are  more  favorably  received  than  are  negatively  valenced  messages.  However, 
positively  and  negatively  vale.^ced  messages  related  to  specific  behavior  appear 
to  be  more  effective  than  similarly  valenced  messages  left  abstract.  This 
study  examined  the  occurrence  of  positive,  negative,  mixed,  and  neutral 
valence  messages. 


RESEARCH  METHODS 


The  research  method  employed  In  this  study  was  content  analysis.  Content 
analysis  is  defined  as  a  technique  for  making  Inferences  by  objectively  and 
syatematlcally  identifying  specified  characteristics  of  messages  (Holsti, 

1969}.  As  a  research  method,  content  analysis  must  meet  three  criteria:  gen¬ 
erality,  objectivity,  and  consistency  of  system. 

First,  generality  means  that  the  content  analytic  scheme  must  be  derived 
from  theory  and  that  the  findings  must  have  theoretical  relevance.  The  content 
analysis  scheme  developed  and  used  for  this  study  vas  based  on  a  model  of  the 
feedback  process  constructed  by  Downs,  Johnson,  and  Barge  (1984)  in  a  recent 
review  of  the  feedback  literature.  The  results  of  this  study  were  interpreted 
on  the  basis  of  standards  for  feedback  effectiveness  revealed  in  that  litera¬ 
ture. 


Second,  objectivity,  stipulates  that  each  step  in  the  research  process  must 
be  carried  out  on  the  basis  of  explicitly  formulated  rules  and  procedures. 
Included  are  rules  for  defining  the  coding  unit,  identifying  and  defining  cate¬ 
gories,  and  distinguishing  among  categories.  Rules  used  in  this  research  are 
defined  in  the  operational  definitions  employed  in  the  coding  scheme  in  Appen¬ 
dix  A. 

Third,  consistency  of  system  refers  to  the  inclusion  and  exclusion  of  data 
or  categories  according  to  consistently  applied  rules.  No  data  from  the  feed¬ 
back  sessions  were  excluded  from  the  overall  analysis. 


Coding  Procedures 


Basic  Message  Unit 

The  basic  message  coding  unit  was  the  individual  utterance.  These  were  de¬ 
fined  operationally  as  any  segment  of  uninterrupted  verbal  discourse  punctuated 
at  the  beginning  and  end  by  a  pause  or  verbal  breach.  For  example,  "(pause)  S2 
did  you  know  what  the  S3  was  doing?  (pause)"  would  be  coded  as  one  utterance. 
Similarly,  "(pause)  I  reported  this  (pause)  as  quickly  as  I  could  (pause)"  was 
coded  as  two  utterances  because  of  the  break  in  the  middle  of  the  sentence. 

Each  utterance  was  coded  in  the  9^  categorical  choices  of  the  feedback  message 
process  analysis  (see  Appendix  A)  in  the  following  way.  First,  each  utterance 
was  assigned  to  one  of  the  four  feedback  component  categories:  Reference  to 
Battle  Performance,  Reference  to  Rationale  for  Performance,  Reference  to  Battle 
Objectives,  or  Reference  to  Future  Performance.  Second,  if  the  utterance  was 
coded  as  Reference  to  Battle  Performance,  it  was  further  assigned  tc  either 
Reference  to  Behavioral  Performance  or  Reference  to  Personal  Characteristics. 
Similarly,  if  the  utterance  was  coded  as  Reference  to  Battle  Objectives,  it  was 
further  assigned  to  either  Reference  to  Individual  Battle  Objectives  or  Refer¬ 
ence  to  Relational  Battle  Objectives  subcategories.  Third,  utterances  were 
further  coded  as  to  their  Form  (question  or  comment),  then  coded  as  to  their 
Level  of  Specificity  (abstract  or  specific),  and  finally  coded  as  to  their 


VAltDnc*  (positlv*,  nsutral,  n«g«tlv«,  or  mizod).  In  •dlitlon  to  the  coding  of 
all  f3edback  aeaaage  data,  the  reaearchera  identified  the  aource  of  each  feed¬ 
back  neadage  when  that  source  vaa  identifiable. 

For  example,  an  utterance  auch  aa,  "At  1100  hours  ve  first  saw  the  enemy 
approaching  from  the  east  down  Highway  24,"  was  coded  aa: 

1.  Keference  to  Battle  Perfozmance  (Feedback  Component) 

2.  Reference  to  Behavioral  Performance  (Feedback  Component-Behavioral  vs. 

Personal  Characteriatics) 

3.  Comment  (Form) 

4.  Specific  (Level  of  Specificity) 

5.  Heutral  (Valence) 

The  utterance  clearly  references  a  Battle  Performance,  an  act  of  observing  the 
enemy;  references  a  Behavioral  Performance,  we  observed  the  enemy;  is  in  the 
form  of  a  Comment  as  opposed  to  a  Question;  is  Specific  with  reference  to  time 
(1100  hours)  and  place  (east  down  Highway  24);  and  is  Neutrally  valenced  since 
the  message  describes  what  took  place  and  does  not  attribute  praise  or  blame  to 
anyone. 

An  initial  application  of  the  coding  scheme  to  the  After  Action  Review 
videotapes  revealed  tnat  not  all  utterances  could  be  assigned  to  a  category. 

Two  additional  categories  were  developed.  Real  Time  was  used  to  code  any  ut¬ 
terance  which  referred  to  the  organisational  format  and  operation  of  the  cur¬ 
rent  after  action  review,  and  did  not  refer  to  the  battle  simulation  exercise. 
For  example,  "Where  is  the  S2  sitting?  Are  you  here  S2?"  Garble  was  used  to 
code  Any  utterance  wh.^ch  was  aurally  unintelligable  to  the  three  data  coders. 
With  the  inclusion  of  these  two  categories,  all  oral  speech  contained  in  the 
AAR  videotapes  was  assigned  to  an  appropriate  category. 

Reliability  Check 

Three  coders  from  the  Communication  Research  Center  at  the  University  of 
Kansas  were  trained  for  a  period  of  one  month  in  the  use  of  "Feedback  Message 
Process  Analysis."  At  the  end  of  the  tr*«ining  period,  a  sequence  of  30  utter¬ 
ances  from  one  of  the  recorded  AAR  sessiuus  was  randomly  selected  to  test  re¬ 
liability  among  the  coders  in  assigned  data  to  categories.  Reliabilities  were 
calculated  using  Krlppendorf 's  (I960)  agreement  coefficient  for  nominal  level 
data.  Intercoder  reliability  on  a  random  sample  of  a  sequence  of  50  utterances 
was  .89. 

Analysis 

Once  inter-coder  reliability  was  established,  the  coders  analyzed  video¬ 
tapes  of  the  AARs  of  five  battalion  command  groups.  The  five  video-tapes  docu¬ 
mented  six  AARs  including  the  third  day  AAR  of  each  of  the  five  battalions 
undergoing  training,  plus  one  second-day  AAR  for  the  first  battalion. 

Source  and  message  data  were  compiled  and  cmalyeed  by  their  frequency  of 
occurrence  and  by  the  proportion  of  their  occurrence  relative  to  the  total 
number  of  utterances  coded  for  each  AAR. 
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RESULTS  AMD  DISCUSSION 


A  total  of  5,781  uttaranea  vara  coded.  Coded  uttarancaa  Involved  408.36 
alnutaa  of  video-taped  natarlal  (aaa  Table  1).  The  mean  tine  length  of  the 
AAR*a  vaa  66.06  ninutea  and  the  aean  nunber  of  utterancea  vae  9€3>5«  Real  time 
■eaaagea  Bade  up  18J(  of  the  total  utterances,  and  garbled  aeaaagea  made  up  3% 
of  the  total. 


Table  1 

Total  NxiBber  and  Length  of  Utterancea  for  each  Battalion 


Battalion 

Utterances 

Duration 

(Minutes: 

Seconds 

U  t  terances 
Per  Minute 

1.1 

1,444 

85:00 

16.99 

1.2 

927 

70:00 

13.24 

2 

1,218 

71:55 

17.02 

3 

769 

53.55 

14.36 

4 

634 

72:29 

8.77 

5 

169 

55:17 

14.30 

Total 

5,781 

408.36 

Kean 

936.5 

68.06 

14.11 

Feedback  Sources 


The  total  nusber  of  persons  actively  participuting  in  the  AARa  varied  from 
6  to  17  across  the  b..tteiIonu.  The  core  group  of  participants  which  emerged 
across  all  AARs  .'’ncli.ded  thn  3attalion/Tark  Force  Commander,  ARTBASS  leader, 
and  Company  CommHnders  (see  Table  2).  The  opposing  force  (OPFCR),  S2,  S3,  S4, 
fire  supporc  officer  (FSO),  and  a  single  brigade  commanier  were  moderate  level 
participants  Another  group  of  12  participants  did  not  make  frequent  utter¬ 
ances. 


Feedback  Contents 


Topics  Discussed  i.:  AARs 

An  analysis  of  the  AAR  videotapes  revealed  that  forty-two  identifiable 
topics  in  si  general  categories  were  discussed  (see  Table  3).  The  categories 
were  troop  deployment  and  terrain,  enemy  characteristics,  coordination,  infor¬ 
mation  fire  support,  and  planning.  Only  five  topics  arose  in  all  of  the  AARs. 
They  were  unit  locations,  type  of  terrain,  enemy  troop  deployment  and  movement, 
surveillance  of  enemy  forces,  and  direct  and  indirect  fire.  There  were  more 
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Tabl*  2 


Ptrotntac*  of  Uttoranooa  by  Souroo 


Bottallon  Overall 


Source 

1-1 

1-2* 

2 

3 

4 

5 

Battalion/ Task 

Force  Couander 

13.6 

63.3 

48.8 

67.0 

3.1 

27.3 

36.9 

ARTBASS  Leader 

0.3 

0.2 

11.3 

11.2 

64.7 

44.1 

17.1 

Coapany  Coamandar 

35.9 

16.9 

16.3 

11.6 

1.4 

16.8 

Opposing  Force 
(OPFOR) 

9.1 

6.2 

1.9 

15.9 

12.5 

7.3 

Brigade  Conaandar 

28.1 

6.9 

S3 

3.7 

1.5 

1.5 

9.2 

9.3 

3.7 

S2 

4.3 

2.8 

4.9 

1.2 

0.3 

4.1 

3.3 

All  Unidentified 
Sources 

8.6 

1.7 

1.3 

4.9 

0.6 

2.6 

Fire  Support 

Officer 

2.4 

1.0 

4.0 

1.6 

S4 

2.6 

2.4 

0.8 

1.7 

1.1 

1.6 

All  Others^ 

4.8 

4.5 

2.6 

0.8 

0.7 

2.2 

Number  of 

Non-Garbled 

Utterances 

1396 

913 

1190 

748 

617 

773 

5637 

a  Battalion  1—2  Indlcataa  aana  battalion  as  1-1,  but  on  a  sacond  day* 

b  All  othara  includa  SI,  ALO,  FIST,  Platoon  Laadar,  battalion  paraonnal, 
brigada  staff,  trainers 
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• 

IMO*  3 

i 

i 

, 

Itopic  0^  ..jgotiw  DiMUMd  in  After  Aotlon  Itevl«M 

1 .  %nop  dbplflofnnt  «1  temin 

a 

-L  4. 

Lolbnaation 

b 

«.  UHte  loontlon 

6 

2 

a.  OorracVinoorract  inlbzuation 

1 

1 

1  b.  of  temin 

6 

1 

b.  Adaquacgr  of  infbxnatioD 

4 

4 

c.  tbvoBBnV'BDbllitar 

3 

2 

c.  Anbdguliy  in  aiapnagaa 

4 

4 

d.  Vnathar  oonditiQOB 

4 

2 

d.  L&prtenoa  of  Inlbnuatlon 

3 

2 

2.  EkMv  ChanctexlstlcB 

a.  Ciitloal  r^portiig 

3 

1 

3 

ralatlonahlpe 

«.  Actuil  wy  atengte 

4 

0 

f.  Auteantloatlon  of  raporta 

1 

1 

b.  Ebny  teoop  daploiynant  A 

6 

1 

g.  Tinallmaa  of  raportlig 

3 

3 

■ovonant 

h.  Platoon  mi  co&paiy  aNara* 

1 

0 

c.  EhaoQr  OMunltios:  troqpa 

3 

0 

naaa  of  infonintlon  available 

1 

•III  «]uipnnt 

1.  ProbloBB  with  vmriatiooB  in 

2 

1 

2 

d.  Boa^/  UM  of  dlrae^ 

3 

1 

inteipretu^  aaooagDa 

indlract  lira 

J.  Radio  uaa 

2 

1 

a.  Boaaiy  acLnaflalda 

3 

1 

1 

f.  Baaiy  uaa  of  iUvoimfcloo 

2 

1  5. 

Hra  aupport 

g.  Ehamr  vm  of  suks 

3 

1 

a.  Uaa  of  iUvaaination 

1 

1 

3.  Oooidimtlaa 

b.  Itoa  of  aaoka 

3 

1 

c.  FASCAN 

3 

1 

a.  NlaalaQ  objactlvaa  to 

4 

0 

d.  Urac^indiiact  fire 

6 

3 

ba  aocacutad 

b.  Miaalan  objactivw 

2 

2  6. 

Planning 

aoconpliahad 

c.  Raapomlbilltiee  than 

2 

1 

a.  Air  auiport  planniig 

2 

0 

auparioza  klllad 

b.  Boginaering  atosport  nlamirtt 

2 

1 

d.  Adequate  paraonnel 

1 

1 

c.  Fire  aupport  plannii^ 

1 

1 

a.  Maxlaial  uaa  of  paraonel 

2 

1 

d.  Itae  of  all  paraonnal  in 

2 

1 

f  .  Ratlcnale  given  Ibr 

3 

0 

planning 

dedaioas 

a.  StreiQgth  and  waakneeaea  of 

3 

3 

g.  Attack  atrategiae 

2 

2 

operation  order,  geoerally 

h.  Survaillanoe  of  aneny 

6 

3 

f.  ProblenB  with  variatiGOB  in 

1 

1 

Ibrcea 

interpretetiona  of  operation 

i.  Troop  d  auppUaa  loeaaa 

2 

2 

order 

;).  Reaupidy  end  ralUaliig 

4 

3 

g.  Need  to  develop  ainple  SQE^ 

1 

1 

k.  Medical  avacuaticn 

1 

1 

fbr  battle 

1.  Air  atrUcaa 

3 

1 

m.  Minallalda/obetaclea 

2 

0 

*  Ikniber  of  latbiliuis  discuaaii^  tho  topic. 

^  Ifcnber  of  tattalicns  discuasing  the  topic  as  e  jzoblem. 
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problraa  associated  with  the  coordination  and  information  catsgoriss  (17  and 
23 I  raspsctivel>} ,  than  the  other  four  categories  (goodness  of  fit  test:  ~ 

22.97,  df  -  5,  P  <  .001) 

Probleus  with  Information.  Adequacy  of  information,  a  problem  in  four 
battalions,  refers  to  a  general  problem  of  members  failing  to  request  or  pro¬ 
vide  vital  information  to  one  another,  especial'y  as  a  battle  intensified. 
Ambiguity  in  messages,  also  a  problem  in  four  battalions,  concerns  the  general 
problem  of  sending  messages  too  abstract  to  be  meaningful  to  other  battalion 
members.  For  exemple,  one  battalion  commander  stated  that  a  platoon's  leader's 
report  of  "having  encountered  a  considerable  enemy  force”  told  him  nothing 
about  the  else  of  the  enemy  force.  Vas  it  a  company,  a  battalion,  or  a  bri¬ 
gade?  As  a  consequence  of  this  message,  the  battalion  commander  noted  that  he 
was  uncertain  as  to  how  he  was  to  respond.  Abstract  messages  made  coordinating 
the  battalion's  forces  more  difficult. 

Timeliness  of  reporting  involved  Informotion  arriving  too  late  to  prevent 
loss  of  personnel  or  to  prepare  troops  for  engaging  the  enemy.  Critical  re¬ 
porting  relationships  centered  on  battalion  personnel  failing  to  inform  other 
battalion  personnel  during  the  battle.  For  example,  in  one  battalion,  one 
company  commander  failed  to  Inform  the  battalion  commander  and  the  TOC  as  the 
battle  intensified. 

Problems  with  variations  in  interpreting  messages  occurred  in  two  AARs. 

The>  refer  to  two  or  more  battalion  members  interpreting  the  same  message  dif¬ 
ferently.  This  is  Illustrated  by  the  company  commander  who  "misinterpreted"  a 
code  name  and  followed  the  wrong  compazv/  into  battle. 

Problems  with  Coordination.  Problems  associated  with  mission  objectives 
accomplished  were  of  two  types.  First,  members  of  two  battalions  experienced 
concern  about  the  relatively  high  casualty  rates  they  sustained  in  attaining 
their  objectives.  In  particular,  some  battalion  members  wondered  if  the  objec¬ 
tives  could  have  been  changed.  Unfortunately,  no  one  suggested  ways  the  battal¬ 
ion  could  have  obtained  the  objectives  with  fewer  casualties.  Second,  members 
of  two  battalions  stated  that  they  were  luicertain  about  the  specific  battle 
objectives  they  were  to  accomplish. 

The  problems  related  to  troop  and  supply  losses  vas  essentially  the  same 
for  each  group;  they  expended  their  ammunition  too  quickly.  As  the  ammunition 
supply  diminished,  so  did  firepower;  and  as  a  consequence  of  decreased  fire¬ 
power,  casualty  rates  in  the  battalion  increased.  Surveillance  of  enemy  forces 
often  became  a  problem  due  to  weather  and  smoke. 

Resupply  and  refueling  problems  were  related  to  the  quick  expenditure  of 
ammunition.  In  essence,  the  resupplying  and  refueling  of  platoons  and  compa¬ 
nies  were  operated  on  a  "trickle  down"  concept  based  on  an  assumption  that 
initial  encounters  by  the  enemy  would  be  "contact  squirmishes"  rather  than 
"full  attacks."  Unfortunately,  the  enemy  employed  full  attack  strategies  which 
forced  the  platoons  and  companies  to  expend  ammunition  more  quickly  than  an¬ 
ticipated.  As  a  result,  there  was  not  enough  time  to  move  ammunition  and  fuel 
from  storage  sites  behind  the  battle  lines  to  the  front. 
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PTformancc  va.  Personal  Charge tarlatlca 


An  examination  of  the  four  basic  feedback  cooponenla  revealed  that  the  mem¬ 
bers  of  all  battalions  talked  most  often  about  their  behavioral  performance 
(Friedman  Rank  Test:  y*  "  ^5i  df  ■  3»  P  <  *005)1  (see  Table  4).  '.'he  results 

of  the  content  analysis  revealed  that  in  all  six  AARs  the  battalions  were  high 
in  referring  to  actual  pex'formance  rather  than  personal  characteristics.  Only 
in  AARs  1-2  and  3  did  messages  referring  to  personal  characteristics  appear, 
and  they  occurred  very  infrequently  (2.7$  and  1.4$  of  total  group  "Battle  Per¬ 
formance"  utterances).  Persons  in  the  other  four  AARs  dealt  on]y  with  actual 
behavioral  performance.  The  six  AARs  may  be  viewed  as  effective  on  this  dimen¬ 
sion. 

Rationale 


In  reconstructing  how  an  important  event  happened  during  the  simulated 
battle,  battalion  personnel  may  serve  as  one  rich  source  of  information.  In 
particular,  they  may  be  able  to  explain  why  they  performed  as  they  did  during 
each  significant  battlefield  event.  Of  the  four  feedback  components,  messages 
requesting  and  giving  "Rationales  for  Battle  Performance"  occurred  the  fewest 
number  of  times  during  the  AARs.  This  average  nay  be  reasonable  since  members' 
reasons  for  performance  is  only  one  source  of  information  concerning  how  sig¬ 
nificant  battle  events  occurred. 

Messages  providing  "Rationales  for  Battle  Performance"  appeared  to  provide 
battalion  commanders  some  understanding  of  the  reasoning  processes  involved  in 
the  battle  actions  taken  by  their  personnel.  Battalion  commanders  used  this 
information  to  illustrate  and  "reinforce",  through  praisst  cjrrect  decision¬ 
making  practices  in  various  battle  situations.  Similarly,  battalion  commanders 
employed  this  Information  to  "correct,"  by  suggesting  alternative  options  to 
poorly  made  decisions.  Finally,  battalion  commanders  often  linked  the  "Ration¬ 
ales  for  Battle  Performance"  to  the  consequences  experienced  by  a  platoon, 
company,  and  the  battalion. 

Goals 


Research  has  consistently  demonstrated  that  messages  which  reference  goals 
in  conjunction  with  messages  which  reference  actual  behavioral  performance 
enhance  the  feedback  process  and  improve  subsequent  performance  more  than  each 
type  of  message  alone.  In  terms  of  the  AARs,  this  category  refers  to  the  prac¬ 
tice  of  linking  actual  behavioral  performance  to  the  consequences  of  that  per¬ 
formance  on  whether  or  not  battle  objectives  were  attained. 

The  roughly  10$  average  for  messages  referencing  "Battle  Objectives"  found 
in  four  of  the  six  battalion  AARs  may  be  reasonable  since  the  number  of  battle 
objectives  may  be  limited  and  the  activities  of  several  personnel  and  echelons 
may  relate  to  the  same  objective.  The  AAR  guidebook  indicates  that  linking 
actual  behavioral  performance  to  subsequent  events  and  outcomes  is  important 
since  it  allows  personnel  to  see  the  consequences  of  their  actions. 
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of  Feedback  Component  Utterances  for  Each  AAS 
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Additionally,  "Battle  Obiectives"  may  exist  at  various  levels  of  the  bat¬ 
talion's  organisation.  Messages  about  "Battle  Objectives"  may  link  individual 
persons'  performance  to  their  "Individual  Battle  Objectives."  Moreover,  other 
messages  about  "Battle  Objectives"  may  link  the  battle  objectives  of  one  indi¬ 
vidual  or  unit  to  other  individuals  or  units.  These  are  tezmied  "fielational 
Battle  Objectives." 

The  results  of  the  content  cuialysis  found  three  different  patterns  among 
the  battalion  AABs.  Two  battalions  had  a  relatively  high  amount  of  messages 
related  to  "Individual  Battle  Objectives"  and  relatively  few  messages  related 
to  "Belational  Battle  Objectives"  (see  Figure  1).  Two  battalions  disployed  a 
relatively  high  percentage  of  "Relational  Battle  Objectives"  and  a  relatively 
low  percentage  of  "Individual  Battle  Objectives"  messages.  The  remaining  two 
battalions  had  a  moderately  high  amount  of  individual  objectives  and  a  mediiun 
amount  of  relational  objectives. 

Establishing  an  exact  ratio  of  "Individual"  to  "Relational  Battle  Objec¬ 
tives"  as  an  ideal  mix  is  rather  difficult.  The  leex'ning  process  might  not  be 
fully  developed  when  this  ratio  becomes  extreme,  as  in  AAR  2  where  "Relational 
Battle  Objectives"  are  seldom  mentioned,  or  in  AAR  5  where  "Individual  Battle 
Objectives"  are  almost  never  discussed. 

Corrective  Action 

This  feedback  component  is  important  in  "reinforcing"  and  continuing  de¬ 
sirable  aspects  of  unit  performance,  and  in  trying  to  identify  some  course  of 
action  which  might  improve  unit  performance.  Results  of  the  content  analysis 
indicate  that  "References  to  Future  Performance"  averaged  17%  in  frequency  of 
occurrence  of  messages. 

In  five  of  the  six  battalion  AAR  sessions.  "References  to  Future  Perform¬ 
ance"  occurred  with  a  relatively  reasonable  frequency.  Various  problems  bat¬ 
talions  encountered  during  the  simulation  exercise  were  relatively  evenly 
distributed  across  all  battalions.  Only  in  one  AAR  did  messages  "reinforcing 
good  performance"  and  "suggesting  ways  to  improve  performance"  occur  quite 
infrequently. 


Message  Structures 
AAR  Leader's  Questions  vs.  Comments 


The  AAR  manual  states  that  the  questioning  technique  is  the  preferred  for¬ 
mat  eiace  it  "encourages  personnel  to  participate  actively  in  the  AAR  ses¬ 
sions."  Since  the  questioning  technique  was  designed  for  implementation  by  the 
AAR  leaders,  only  their  utterances  were  analyzed.  An  examination  of  the  AAR 
sessions  reve<iled  that  the  questioning  technique  was  rarely  used  by  the  AAR 
leaders.  The  only  notable  exception  was  the  AAR  leader  in  Battalion  2  who  used 
questions  in  41^  of  his  utterances  (see  Table  4). 
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In  terms  of  the  four  basic  feedback  components,  most  of  the  questions 
raised  by  AAR  leaders  concerned  "Battle  Performance."  In  three  AAR  sessions, 
no  questions  were  posed  concerning  "Rationales  for  Performance,"  "Battle  Objec¬ 
tives,"  or  "References  to  Future  Performance."  Consistently,  the  lowest  ratio 
of  questions  to  the  comments  occurred  in  "References  to  Future  Performance." 
With  the  exception  of  AAR  1-1  and  2,  the  questioning  technique  was  used  to 
encourage  personnel  to  describe  their  "Behavioral  Battle  Performance,"  but  was 
seldom  if  ever  used  to  encourage  personnel  involvement  in  the  other  feedback 
areas. 


Abstract  vs.  Specific  Feedback 

Feedback  research  has  supported  consistently  the  finding  that  feedback 
messages  containing  specific  Information  about  "Behavioral  Battle  Performance," 
"Rationales  for  Performanoe,"  "Battle  Objectives,"  and  "References  to  Future 
Performance"  are  more  meaningful  and  useful  to  recipients  than  messages  which 
contain  strictly  abstract  information,  e.g. ,  "You  did  a  good  job."  "Your  in¬ 
formation  was  incomplete,"  "Do  your  best,"  etc.  These  findings  do  not  mean 
that  messages  containing  abstract  information  are  necessarily  bad,  since  they 
may  refer  to  general  principles  to  be  applied  in  battle  or  serve  as  introduc¬ 
tory  and  summary  comments  in  the  feedback  process.  Messages  containing 
abstract  Information  should  be  linked  (either  preceded  by  or  followed  by)  to 
messages  containing  specific  information  which  further  explains  the  abstract 
information.  A  high  preponderance  of  abstract  messages  might  indicate  that 
personnel  lacked  specific  information  on  what  they  did  that  was  "good"  or 
"poor"  and  how  they  might  improve.  On  the  other  hand,  a  high  preponderance  of 
specific  messages  might  suggest  that  personnel  were  not  given  principles 
generaliznble  beyond  the  simulated  battle  experience. 

The  results  of  the  content  analysis  of  the  six  AAR  sessions  revealed  that, 
in  general,  there  was  neither  a  high  preponderance  of  abstract  nor  specific 
messages  (average  of  40^  of  messages  were  abstract).  For  individual  AARs 
abstract  messages  ranged  from  33$  to  4^  (see  Table  5). 

Examination  of  questions  and  comments  related  to  the  four  basic  feedback 
components  as  to  their  abstractness  or  specificity  revealed  three  general  jjat- 
terns  in  the  AAR  session.  First,  questions  posed  in  an  abstract  manner  tended 
to  generate  abstract  comments.  Second,  not  asking  questions  tends  to  generate 
a  higher  number  of  abstract  as  opposed  to  specific  comments.  Finally,  specif¬ 
ically  stated  questions  prompted  comments  containing  specific  information. 

Message  Valence 

The  content  analysis  revealed  that  2$  of  all  utterances  either  explicitly 
attributed  praise  or  blame  to  personnel.  Of  the  99  valenced  messages,  85  were 
positive,  while  14  were  negative.  Research  has  suggested  that  positively  and 
negatively  valenced  messages  related  to  specific  behavioral  references  are  more 
effective  in  enhancing  performance  than  similarly  valenced  messages  at  an  ab¬ 
stract  level.  Analysis  of  the  valenced  messages  indicated  that  89$  were  left 
abstract  (88  out  of  99),  i.e.,  never  related  to  specific  behavior,  rationales 
for  performance,  battle  objectives,  or  future  performance. 


of  Feedback  Components  Question/ Comment  Utterances  for  the  AAB  Leader  of  Each  AAR 


Comment  265  406  288  509  2  0  424  1959 


Ths  majority  of  mesaagea  when  pralae  or  blame  waa  attributed  to  peraonnel 
meeaagea  were  left  aba tract  and  may  not  have  been  effec  ively  used.  Since 
specific  behavioral  referents  were  seldom  mentioned,  battalion  personnel  may 
not  have  known  exactly  for  what  they  were  being  "praised'  or  "blamed."  A  fail¬ 
ure  to  link  "praise"  or  "blame"  Information  to  specific  "Behavioral  Battle 
Performance,"  "Rationale  for  Perfoimance,"  "Battle  Objectives,"  and  "References 
to  Future  Performance,"  during  the  AAR  feedback  sessions  may  lessen  the  effec¬ 
tiveness  of  these  types  of  messages  for  "reinforcing"  good  performance  and 
"correcting"  poor  performance. 
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SUMMARY  AND  CONCLUSIONS 


Content  analysis  vas  employed  in  the  study  and  provided  a  systematic  method 
for  describing  and  evaluating  human  communication  feedback  generated  in  six 
after  action  reviews  (AARs.).  These  were  videotaped  when  they  occurred  after 
ARTBASS  battalion  command  staff  training  exercises.  The  content  analysis  was 
specifically  tailored  for  this  application  and  for  examining  the  frequency  of 
occurrence  on  several  feedback  Issues.  Feedback  sources  were  examined  to 
determine  the  extent  of  participation  by  all  members  of  the  AAR.  Feedback 
content  was  analyzed  both  in  terms  of  topics  discussed  and  process  components. 
Feedback  message  structures  were  analyzed  to  determine  if  good  communication 
practices  were  used  in  the  AARs. 

Feedback  Sources 


The  sources  of  feedback  varied  among  the  six  AARs  from  8  to  17  partici¬ 
pants.  The  core  group  which  generated  71^  of  the  utterances  were  the  Battal¬ 
ion/Task  Force  Commander,  the  ARTBASS  leader,  and  the  company  commanders.  The 
number  of  participants  and  their  degree  of  participation  was  highly  influenced 
by  the  individuals  leading  the  AAR  sessions  as  can  be  seen  from  contrasting  two 
battalions.  Of  all  six  AAR  sessions,  the  AAR  leader  of  Battalion  2  asked  the 
most  questions  of  his  personnel  and  had  the  highest  number  of  participants. 
Conversely,  the  AAR  leader  of  Battalion  4  was  among  the  three  AAR  leaders  who 
asked  the  fewest  number  of  questions  and  had  the  lowest  number  of  participants. 
Feedback  should  come  from  multiple  sources  as  opposed  to  a  single  source. 
Participation  in  the  AAR  also  leads  to  greater  acceptance  of  evaluative  feed- 
back. 


Feedback  Content 

The  results  of  the  content  analytic  scheme  were  used  to  identify  and  de¬ 
scribe  important  qualities  of  the  feedback  in  the  six  AAR  sessions.  Further,  . 
these  results  were  evaluated  in  terms  of  four  principles  of  effective  feed¬ 
back.  Employing  the  four  basic  components  of  the  feedback  process  is  an 
important  step  toward  an  effective  feedback  session. 

AAR  discussion  topics  were  classified  into  six  general  categories  and  42 
individual  topics.  Two  categories,  coordination  and  information  usage,  were 
disucssed  as  problem  areas  the  most.  There  were  ten  topics  of  concern  in  the 
AARs  concerning  the  coordination  of  forces.  Of  concern  in  information  usage 
was  the  correctness  of  information  and  the  ambiguity  in  messages. 

When  providing  feedback  about  "Battle  Performance,"  references  concerning 
actual  "Behavioral  Battle  Performance"  are  more  effective  than  references  con¬ 
taining  inferences  about  the  "Personal  Characteristics"  of  personnel  in  deter¬ 
mining  "what  happenedT^ The  results  of  the  content  analysis  revealed  that  all 
battalions  demonstrated  the  more  ei'fective  choice. 


¥hen  atbemptlng  to  reconstruct  how  a  critical  event  occurred  during  the 
battle  exercise,  one  rich  source  of  information  is  the  batt'\lion  personnel 
themselves.  Four  of  the  six  AAR  sessions  demonstrated  an  "idequate"  number  of 
messages  concerning  members'  "Rationale  for  Battle  Performance,"  while  these 
messages  seldom  occurred  in  two  of  the  AARs.  The  AAR  leader  for  Battalion  2 
requested  and  was  given  "Rationales  for  Battle  Performance"  (11$  of  the  time) 
while  the  AAR  leader  for  Battalion  4  never  requested  and  was  seldom  given  such 
information. 

Feedback  messages  which  link  actual  behavioral  performance  to  "Battle  Ob¬ 
jectives"  are  more  effective  in  improving  performance  than  messages  about  per¬ 
formance  or  objectives  alone.  Four  of  the  six  battalion  AAR  sessions  reflected 
a  reasonable  and  effective  use  of  this  feedback  component.  The  Battalion  4  AAR 
session  was  slightly  higher  than  the  average  for  this  type  of  message,  while 
personnel  involved  in  the  AAR  of  Battalion  3  seldom  linked  their  actual  behav¬ 
ioral  performance  to  "Battle  Objectives." 

"Battle  Objectives"  exist  at  different  levels  of  an  organization.  "Individ¬ 
ual  Battle  Objectives"  for  individual  personnel,  platoons,  etc.,  exist  as  well 
as  "Relational  Battle  Objectives"  at  the  battalion  level.  Three  patterns  of 
individual  and  relational  objectives  were  observed.  Messages  which  relate  in¬ 
dividual  battle  objectives  to  battalion  objectives  are  more  effective  for  en¬ 
hancing  performance  than  messages  which  center  exclusively  on  one  level  or  the 
other. 

In  attempting  to  "reinforce"  good  performance  and  to  "improve"  poor  per- 
; ormance ,  messages  which  link  past  performance  to  "References  to  Future  Per¬ 
formance"  enhance  the  feedback  process.  References  to  future  performance  were 
not  made  frequently  in  only  one  of  the  AARs. 

Feedback  Message  Structures 

Although  the  relative  presence  or  absence  of  messages  concerning  the  basic 
components  of  feedback  can  affect  future  performance,  other  qualities  in  these 
messages  can  have  an  effect  as  well. 

The  AAR  manual  encourages  AAR  leaders  to  use  the  questioning  technique 
'ing  the  sessions  since  questioning  encourages  more  personnel  to  actively 
participate  and  subsequently  Improves  training.  The  results  revealed  tha't.  the 
questioning  technique  was  used  by  the  AAR  leaders  only  13^  of  the  time,  al¬ 
though  there  was  a  large  variation  among  them,  ranging  from  5$  to  41$.  The 
questioning  technique  should  be  used  during  the  AAR  to  encourage  participation 
and  to  di*aw  out  evaluative  comments  on  performance. 

A  high  preponderance  o^  abstract  as  onposed  to  specific  messages  or  vice- 
versa  is  less  effective  when  discussing  the  basic  feedback  components  than  a 
more  equivalent  mix.  Overall,  the  number  of  abstract  and  specific  messages  was 
nearly  equal.  Three  general  tendencies  were  observed:  abstract  questions 
generated  abstract  comments,  abstract  comments  were  more  frequent  when  few 
questions  were  asked,  and  specifically  stated  questions  led  to  specific  res¬ 
ponses. 
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Poaitlv«ly  and  nautrally  valanoad  Msaagaa  are  viewed  more  favorably  by 
peraonnel  than  negatively  valenoed  neaaagea.  Only  2]C  of  the  aeaaagea  were 
poaltlve  or  negative.  Overall,  the  alz  AAR  aeaaiona  were  effective  in  avoiding 
"blaming"  peraona  for  how  the  battalion  performed.  However,  when  praiae  or 
blame  warn  attributed  to  performance,  81  of  the  aeaaagea  were  atated  abatractly 
ao  that  peraonnel  may  not  have  known  apecifloally  for  what  they  were  being 
"pralaad"  or  "blamed."  In  thia  aenae,  the  uae  of  "praiae"  or  "blame"  may  not 
have  been  affective  in  the  AARa  examined  in  thia  atudy.  When  praiae  or  blame 
ia  uaad  the  meaaage  muat  be  apecific  enough  to  have  an  effeotive  impact  on 
future  performance. 

Final  Note 


Thia  report  haa  identified  deaired  feedback  charaoteriatlca  and  haa  de- 
acribad  the  adherence  of  aelected  AARa  to  the  prlnciplea.  Some  battaliona 
exhibited  a  more  effective  feedback  preaentatlon  proceea  than  othera.  Only  one 
problem  emerged  conaiatently  acroaa  the  alx  AAR  aeaaiona:  the  failure  of  the 
AAR  laadera  to  implemant  tha  quaationing  technique. 

Additional  guidance  for  conducting  effective  AARa  ia  available  in  aevoral 
aourcea.  Appendix  B  in  thia  report  providaa  the  tranacript  of  a  videotape 
preaentatlon  on  what  makea  an  AAR  effective.  Scott  A  Fobaa,  (1962),  and  Kaplan 
&  Falleaen  (1986),  provide  atep-by-atep  guidance  on  how  to  prepare  for  and  ' 
conduct  effective  AARa. 


i 
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APPBHDIX  A 


FEEDBACK  MESSAGE  PROCESS  ANALYSIS  AND 
CONTENT  ANALYSIS  CODING  FORM 

OPERATIONAL  DEFINITIONS 

Th«  "Fvsdback  Nassaga  Procaaa  Analyaia**  is  an  alaborata  contant  analytic 
achama  conatructad  specifically  to  dascrlba  tha  faadback  procasses  found  In 
Aftar  Action  Ravlavs. 

I.  Faadback  Components 

A.  Rafaranca  to  Past  Battle  Performance 

1 .  Behavioral  Performance 

2.  Personal  Characteristics 

B.  Rationale  for  Performance 

C.  Goals/Battla  Objectives 

1.  Individual  Laval 

2.  Ralational/Taam  Level 

D.  Future  Performance 

II.  Form 

A.  Question 

B.  Comment 

III.  Level  of  Specificity 

A.  Abstract 

B.  Specific  References 

IV.  Valence 

A.  Positive 

B.  Negative 

C.  Mixed 

D.  Neutral 

An  operational  definition  for  each  of  these  is  given  below. 
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OPERATIORAL  DEFINITIONS 


I*  F»»db«ck  CoBpontnt  PlBfnalonat 

A.  R«f«r«no«8  to  post  porformanc*  v«r«  dofinod  as  Rafarancs  to  Battla 
Parforaanca.  Baaad  on  tha  raviaw  of  litaratura,  two  aub-catagorias 
vara  constructad:  rafaranca  to  bahavioral  parfomanca  and  rafaranca 
to  parfomanca  baaad  on  paraonal  obaractaristica* 

( 1 )  Rafaranca  to  Bahavioral  Parfomanca;  Any  uttaranca  which 
dascribad  or  attributed  auooaaa  or  failure  to  an  action  baaad  on 
tha  parfomanca  or  non-parfomanca  of  soma  bahaviorally  grounded 
action  by  any  aambarCa)  of  tha  battalion  during  tha  simulation 
azarciaa.  Exampla:  "Va  apottad  tha  anamy  coming  up  Highway  24 
and  I  raportad  hia  movamant  immadiataly  to  tha  82." 

(2)  Rafaranca  to  Parfomanca  Baaad  on  Personal  Charactaristica; 

Any  uttaranca  that  attrilsutad  succaas  or  failure  to  action  during 
tha  simulation  baaad  on:  (a)  ability  level  of  group  mambars» 

(b)  knowledge  level  of  group  mambara,  or  (c)  effort  level  of 
group  mambara.  Example:  "Tha  S2  is  tha  smart  guy;  ha  knew  what 
ha  was  doing." 

B.  Reasons  for  paat  parfomanca  ware  operatlonalisad  as  Rstionala  for 
Parfomanca;  Any  uttaranca  that  provided  or  requested  reasons  and/or 
Justification  why  certain  behaviors  were  perfomad  or  not  performed. 
Exampla:  "Ve  didn't  taka  any  casualties  because  wa  didn't  receive 
any  anamy  fire,  either  directly  or  indirectly." 

C.  Goals  were  operationally  defined  as  References  to  Battle  Objectives. 
Again  two  sub-categories  were  constructed:  references  at  an  individual 
level  and  references  at  a  relational  level. 

( 1  )  References  at  an  Individual  Level;  An  utterance  which  referred 
to  planned  desired  outcomes  of  a  battle,  whether  contained  in 
the  operations  order  or  modified  due  to  battle  conditions.  These 
desired  outcomes  are  for  a  single  person,  platoon,  or  company. 
Example:  "Sir,  my  mission  as  leader  of  Alpha  Company  was  to 
defend  and  hold  battle  position  ten." 

(2)  References  at  a  Relational  Level:  An  utterance  that  referred  to 
the  planned  desired  outcomes  of  a  larger,  interrelated  group; 
i.e.,  how  platoon  goals  relate  to  company  goals,  how  company  goals 
relate  to  battalion  goals,  how  battalion  command  members'  goals 
relate  to  each  other.  Example:  "As  S2,  I  immediately  sent  the 
intelligence  report  about  enemy  movements  to  Charlie  Company  so 
that  they  could  alter  their  approach  in  securing  the  bridge." 


D.  References  to  futur.  performance  were  defined  as  References  to  Future 
Battle  Performance;  Any  utterance  which  served  to  prescribe  or  sug¬ 
gest  a  continuation  or  correction  in  behaviors  or  activities  which 
should  occur  in  future  battle  situations.  Example:  "In  the  future 
when  your  companies  are  as  closely  deployed  to  one  another  as  they 
were  today,  you  should  distribute  all  of  the  ammo  at  once,  rather  than 
dole  it  out  over  the  course  of  the  battle." 

II.  Form 


A.  Question;  Any  utterance  which  served  to  request  information  concern¬ 
ing  battle  performance,  rationale  for  performance,  battle  objectives, 
or  future  performance.  Example:  "S2,  did  Alpha  Company  report  to 
you  their  sighting  of  the  enemy?" 

B.  Comment;  Any  utterance  which  functioned  to  give  information  related 
to  battle  performance,  rationale  for  performance,  battle  objectives, 
or  future  performance.  Example:  "Sir,  we  accomplished  our  mission 
at  14C0  hours." 

III.  Level  of  Specificity 

A.  Abstract  References;  Any  utterance  that  referred  to  general  or 
abstract  concerns  with  battle  performance,  rationale  for  perform¬ 
ance,  battle  objectives,  or  future  performance,  but  did  not  include 
concrete  instances  or  examples  that  occurred  during  the  simulation 
exercise.  In  addition,  all  perfunctory  responses  such  as  "Yes," 

"No,"  "1  agree,"  etc.,  were  coded  as  abstract.  Example:  "Our 
coordination  was  poor." 

B.  Specific  References;  Any  utterance  that  utilized  concrete  instances 
or  examples  that  occurred  during  the  simulation  exercise  such  as: 

(l)  a  specific  reference  to  a  battle  position,  (2)  a  specific 
reference  to  a  battle  event,  (5)  a  specific  behavior  or  time  was 
referenced,  (4)  an  explicit  hypothetical  example  was  used.  Example; 
"The  coordination  of  information  between  the  S2  and  S3  was  poor  after 
the  start  of  the  battle.  For  example,  half  an  hour  into  the  battle, 
the  S2  gathered  information  concerning  X  and  failed  to  pass  it 
immediately  to  the  S3." 

IV.  Valance 


A. 


B. 


Positive;  Any  utterance  that  explicitly  evaluated  personnel  for  good 
pei  'irmance  through  praise.  Example:  "I  thought  you  made  a  good 
det  Ion  to  call  for  resupply  at  2100.  By  doing  that,  you  did  not 
run  ut  of  ammo." 

Negative;  Any  utterance  that  explicitly  evaluated  personnel  for  poor 
performance  through  blame.  Example:  "This  was  a  bad  decision  you 
made  and  it  cost  us  quite  a  few  casualties.  What  was  the  matter  with 
you,  anyway?" 
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C.  Mixed ;  Any  utterance  which  evaluated  personnel  positively  and  nega¬ 
tively  or  positively  and  neutrally,  or  negatively  and  neutrally 
simultaneously.  Example:  "You  are  getting  better  at  coordinating 
your  information.  Can  you  do  better?" 

D.  Neutral;  Any  utterance  which  neither  praised  nor  blamed  personnel 
for  performance,  but  simply  described  behavioral  or  menfcal  (e.g. , 
decision-making  activities.  Example:  "At  1100  hours  you  saw  the 
enemy  approaching  from  the  woods,  correct?" 

This  category  scheme  yielded  ninety-six  different  categorical  choices  based  on 
the  number  of  different  decisions  concerning  each  utterance. 
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APPENDIX  B 


SUMMARY  OP  A  VIDEOTAPE  TRANSCRIPT 
,,  OH  AFTER  ACTION  REVIEWS 

Presenter:  by  Cal  Downs 


The  most  Important  element  In  AARs,  as  In  all  communication,  is  feedback. 

The  five  major  elements  of  good  feedback  messages  are  as  follows: 

1.  Description  -  The  description  element  tells  exactly  what  happened  and 
how  it  happened. 

2.  Rationale  -  The  rationale  tells  why  it  happened. 

3.  Evaluation  -  The  evaluation  element  Judges  whether  the  action  was  good 
or  bad. 

4.  Goals  -  The  evaluation  should  be  related  to  group  and/or  individual 
goals. 

5.  Corrective  Action  -  This  element  identifies  ways  in  which  performance 
might  be  improved  in  the  future. 


Introduction 

The  AAR  introduction  takes  place  when  the  team  first  gets  together  for  the 
AAR.  The  three  key  elements  which  should  occur  during  the  introduction  are: 

1.  Review  the  learning  agenda  for  the  exercise. 

2.  Set  the  climate  for  the  AAR  to  secure  maximum  participation.  Ideally, 
the  climate  should  be  structured  but  not  intimidating. 

3.  Set  the  expectancy  in  regards  to  roles  that  people  are  to  play  in 
conducting  the  AAR. 


Summary  of  Film  Excerpt  No.  1 

The  AAR  leader  in  this  excerpt  set  a  climate  conducive  to  participation  by 
displaying  a  relaxed  manner  himself,  and  by  acknowledging  hardware  problems 
with  the  computer  and  complimenting  the  group's  patience. 

The  learning  agenda  was  not  reviewed,  but  the  expectancy  was  set  by  telling 
the  group  exactly  what  was  expected  in  regards  to  who  would  talk,  when  they 
would  talk  and  what  they  would  talk  about.  Specifically,  the  instructions  and 
procedures  explained  were: 

The  Company  Commanders  will  speak  first,  and  should  tell  how  they  fought 
the  battle  in  theii  sector,  what  were  the  key  events  and  how  did  they 
end  up  in  regards  to  combat  power  at  the  close  of  the  exercise. 

The  S2  will  then  tell  what  he  heard  based  on  the  Company  Commander's 
reports. 

The  S3  will  report  the  same  sort  of  thing  as  the  S2  based  on  his  mission 
and  how  he  organized  the  ground  to  accomplish  the  mission. 
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The  Air  Lefenae/Fire  Support  Officer  vill  report  the  same  sort  of  thing 
bringing  out  hio  ovn  part. 

The  Enemy  Commander  (who  ia  atill  alive)  vill  brief  on  hov  he  attacked 
through  the  aector. 


Summary  of  Film  Excerpt  Mo.  2 

The  AAR  leader  explained  that  the  focua  vill  be  on  evaluating  the  exerciae, 
not  individual  critlquea.  Hovever»  performance  of  individual  rolea  on  division 
or  brigade  staff  vill  be  included  in  the  evaluation. 

The  atmosphere  of  this  AAR  vaa  stiff  and  not  conducive  to  participation. 
Hovever,  the  AAR  leader  did  reviev  the  learning  objectives  and  explained  the 
procedures  in  a  general  vay.  Instructions  vere  given  to  participants  to  brief 
on  vhat  the  critical  events  vere,  vhat  happened,  hov  it  happened,  and  alterna¬ 
tives  to  make  it  better  next  time. 


Topics 

A  vide  variety  of  topics  are  discussed  in  AARs,  but  the  six  most  common 
topics  are: 

1 .  Coordination  of  the  battle 

2.  Information  dissemination  and  use 

3.  Enemy  characteristics 

4.  Planning 

'  5*  Troop  deployment  and  terrain 
6.  Fire  Support 


Participation 

Participation  is  heavily  related  to  the  atmosphere  that  is  created  during 
the  introduction.  The  AAR  leader  should  make  an  effort  to  drav  in  and  include 
people  vho  seem  reluctant  to  participate.  The  folloving  suggestions  can  help 
create  an  atmosphere  conducive  to  maximum  participation: 

1 .  Feedback  regarding  the  group  performance  should  be  given,  as  veil  as 
individual  feedback. 

2.  People  should  be  made  to  feel  that  it  is  permissible  to  disagree. 

3«  The  focus  should  be  on  rationale  through  frequent  use  of  "why” 

questions. 

4.  Questioning  techniques  should  be  used  that  promote  discussion  and 
interaction  and  vhich  relate  people  and  their  performance  to  one 
another. 

Summary  of  Film  Excerpt  Ho.  3 

The  AAR  leader  asked  questions  that  he  did  not  vant  or  expect  an  ansver  to, 
but  vhich  vere  asked  to  "give  the  person  something  to  think  about". 

The  AAR  leader  asked  the  staff  to  discuss  their  parts  and  to  "make  each 
other  smart".  A  better  method  vould  have  been  to  describe  behaviors  and  then 
ask  for  possible  alternatives. 
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Summary  of  Flla  Excerpt  Ho.  4 


Thm  AAR  leader  asked^ direct  and  closed  queationa  leading  to  aimple  ''yea" 
or  "no"  answers.  |  He  then  usually  gave  the  reason  why  he  asked  the  question, 
and  a  critique  which  would  lead  to  another  direct  question. 

This  method  of  questioning  raises  the  issue  of  how  possible  it  is  for  the 
group  to  disagree,  and,  therefore,  limits  participation. 


Summary  of  Film  Excerpt  Ho.  5 

The  AAR  leader  asked  direct  questions,  but  they  were  questions  which 
related  one  person's  performance  to  another.  He  encouraged  people  to  direct 
questions  to  each  other  rather  than  through  the  AAR  leader.  Once  the  individ-  i 

uals  began  direct  communications,  the  AAR  leader  performed  as  moderator,  and 
kept  the  discussion  going  through  further  questions.  The  group  was  led  to  make 
important  points  fox  themselves,  rather  than  the  AAR  leader  making  the  points 
himself.  This  AAR  leader  often  used  "why"  questions  which  focused  on  ration¬ 
ale. 

Description  j 

l 

Descriptive  communication  should  have  the  following  elements:  | 

1.  Be  specific  -  abstractions  should  be  avoided.  Statements  such  as  < 

"I  didn't  get  a  good  feel  for...."  or  "Ve  didn't  have  our  timing  J 

down"  should  be  replaced  with  more  specific  statements. 

2.  Be  thorough  -  avoid  the  inclination  to  "make  a  long  story  short". 

3.  Focus  on  behaviors. 

4.  Refer  to  goals  and  how  successfully  they  were  met. 


Summary  of  Film  Excerpt  Ho.  6 

This  film  excerpt  consisted  primarily  of  the  speaker  giving  lengthy  and 
detailed  descriptions  of  locations  and  behaviors.  The  speaker  used  the  phrase 
"1  didn't  get  a  good  feel  for....". 


Summary  of  Film  Excerpt  Ho.  7 

The  speaker  in  this  excerpt  was  not  thorough  or  concrete.  He  used  the 
following  phrases: 

"Ve  didn't  have  our  timing  down  and  that's  why....” 

"Ve  were  a  little  more  successful...." 

"To  make  a  long  story  short...." 
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Suwry  cf  ?!!■  Exorpt  Mo.  8 


The  speaker  In  this  excerpt  was  ,  both  thorou^  and  concrete.  He  began  by 
stating  his  objective  -  to  Identify  the  enemy  mission  and  delay  the  enemy’s 
progress.  He  Identified  the  enemy  by  specific  unit,  and  gave  a  detailed 
behavioral  description  of  activities,  terrain  points  for  defense  by  terrain 
location  and  physical  description  and  visibility.  He  stated  his  concept  of  his 
operation  and  hov  he  attempted  to  do  it,  his  exact  battle  positions,  and  the 
air  support  which  was  available.  He  described  reports  which  came  to  him  and 
what  he  did  as  a  result  (where  the  enemy  was  coming  from  and  existing  condi¬ 
tions).  He  also  described  exactly  what  happened  when  the  enemy  was  engaged  and 
gave  specific  information  about  losses  and  further  courses  of  action.  This 
speaker  constantly  referred  to  goals  and  gave  an  implied  evaluation  of  how  well 
the  goals  were  achieved. 


Evaluation 


The  evaluation  should  refer  to  what  went  right  and  what  went  wrong  for  both 
the  group  end  the  individuals.  Evaluation  can  be  positive,  negative  or  neu¬ 
tral.  No^t  AABs  tend  to  be  either  neutral  or  the  participants  are  unaware  of 
any  evduatlon  at  all. 


Sunnary  of  Film  Excerpt  Ho.  9 

This  speaker  gave  abundant  numerical  information  about  losses  and  what  he 
had  left  after  the  battle,  however,  there  was  no  analysis  or  evaluation  which 
was  related  to  goals. 


Summary  of  Film  Excerpt  Ho.  10 

This  speaker  said  that  he  ’’missed  the  implied  mission"  and  talked  about 
what  they  did  and  why  it  was  ineffective.  He  asked  for  comments  from  the 
division  and  brigade  staff  members.  Suggestions  were  made  on  how  the  deficient 
behaviors  could  have  been  done  better  and  further  failures  were  pointed  out. 
This  excerpt  was  an  example  of  a  negatve  evaluation.  Positive  evaluation  is 
needed  as  well. 


Summary  of  Film  Excerpt  Mo.  11 

This  speaker  talked  of  the  exercise  objective  of  the  team  (as  opposed  to 
the  training  objectives).  The  AAB  leader  used  questioning  techniques  to  lead 
the  group  to  self-analysis  of  the  team  and  an  evaluation  of  the  goals. 


Goals 


Goals  are  closely  related  to  the  evaluation,  as  the  goals  are  usually  the 
criteria  used  for  determining  success  or  failure  in  the  evaluation. 

There  should  be  an  analysis  of  the  successes  and  the  failures  -  why  did 
they  occur  and  what  are  some  possible  future  alternatives  in  regards  to  the 
failures. 


Conclusion 


The  conclusion  is  the  time  to  summarize  the  exercise  -  to  bring  It  all 
together  and  highlight  the  main  points.  During  this  time  the  learning  objec¬ 
tives  and  goals  should  be  combined  with  evaluation.  This  Is  a  very  Important 
time  when  generalizations  can  be  made  and  learning  reinforced.  The  conclusion 
should  Include  both  the  battle  objectives  and  the  learning  objectives. 


Summary  of  Fils  Excerpt  No.  12 

The  AAR  leader  summarized  the  exercise  and  stated  his  feelings  in  regard  to 
the  team’s  performance  during  the  exercise.  He  reviewed  the  mission  and  spoke 
of  the  lack  of  specificity  of  certain  parts,  i.e. ,  "To  return  healthy"  which 
was  never  operationally  defined.  He  said  because  of  the  lack  of  specifics. he 
was  not  sure  how  well  he  did,  but  that  they  had  weakened  the  enemy  and  caused 
him  to  commit  his  second  echelon  of  the  lead  division.  However,  he  felt  that 
they  probably  had  not  weakened  the  enesy  enough,  and  vent  on  to  speak  of  diffi¬ 
culties  encountered. 


Summary  of  Film  Excerpt  No.  13 

The  AAR  leader  in  this  film  dealt  with  the  learning  objectives.  He  spoke 
about  one  of  their  identified  training  needs:  "to  train  as  a  team  before  they 
need  to  perform  high  speed  things  as  a  team".  He  said  that  the  exercise  as  a 
whole  made  the  staff  better  at  analyzing  problems  and  problem  solving  proce¬ 
dures.  He  felt  that  the  team  started  slow  but  that  their  performance  improved. 
The  evaluator  was  asked  to  rank  the  team  on  their  performance  on  training 
objectives  from  strongest  to  weakest. 


Summary 

The  seven  components  of  an  effective  AAR  are: 

1 .  Introduction  -  The  introduction  is  very  important  and  should  set  the 
climate  to  secure  maximum  participation,  and  set  the  expectancy  in 
regards  to  the  roles  individuals  are  to  play  in  conducting  the  AAR. 

2.  Topics  -  Hany  topics  could  be  included  in  the  AAR  but  there  are  six 
which  moat  frequently  occur. 

3.  i.jrticip&  iion  -  Participation  is  extremely  important  and  can  be 
enhanced  through  the  use  of  questioning  techniques.  In  the  research 
conducted  by  University  of  Kansas  it  was  noted  that  very  few  AAR 
leaders  used  questioning  techniques,  but  those  who  did  were  very 
effective  iz  'uring  participation. 

4.  Description  Description  is  very  important  and  should  be  thorough, 
factual,  and  oriented  tojrards  behaviors. 

3.  Evaluation  -  Description  is  not  enough.  Evaluation  is  also  needed 
to  determine  if  performance  was  good  or  bad  based  upon  the  goals. 
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6.  Goftla  >  Goals  and  evaluation  should  be  tied  together.  The  goals  are 
usually  the  criteria  for  determining  success  or  failure. 

7.  Conclusion  -  The  conclusion  should  bring  the  main  points  of  the  AAR 
together  to  reinforce  training. 


